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Abstract 



Free entropy is the analogue of entropy in free probability theory. The paper is a survey 
of free entropy, its applications to von Neumann algebras, connections to random matrix 
theory and a discussion of open problems. 



Introduction 

Entropy, from its initial appearance in thermodynamics and passing through statistical me- 
chanics and the mathematical theory of communications of Claude Shannon, has come to 
play, in various guises, a fundamental role in many parts of mathematics. This article is 
about a recent addition ([35]) to the mathematical territory of entropy . 

Free entropy refers to the analogue of entropy in free probability theory, i.e. a quantity 
playing the role of entropy in a highly noncommutative probabilistic framework, with inde- 
pendence modelled on free products instead of tensor products. Free probability theory can 
be viewed as a parallel to some basic probability theory drawn starting from a new type of 
independence. Surprisingly, the parallelism of the classical and free theories appears to go 
quite far, as illustrated for instance by the existence of a free entropy theory. 

From another perspective, free probability, and in particular free entropy, has deep con- 
nections on one hand with the asymptotic behavior of large random matrices and on the 
other hand with operator algebras. One consequence is that the von Neumann algebras of 
free groups, once viewed as exotic creatures, are now much better understood and perceived 
as important objects. 

Acknowledgments. Part of this work was done by the author for the Clay Mathematics 
Institute. Partial support was also provided by National Science Foundation grant DMS- 
0079945. 
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1 Free Probability Background 



1.1 Some basic laws 

Free probability theory being a parallel to classical probability theory, we may compare the 
two by taking a look at corresponding fundamental distributions. 

a) The role of the Gaussian distribution in free probability theory is held by the 
semi-circle distribution, which is a distribution with compact support. 

b) For the Poisson distribution, the free correspondent is a distribution related 
to the semi-circle law. It is also a compactly supported distribution which has 
at most one atom. 

c) The free Cauchy distribution is the Cauchy distribution itself, i.e. the free 
correspondent is the same as the classical law. 

The semi-circle distribution occurs in random matrix theory, where Wigner discovered 
that it is the limit distribution of eigenvalues of large hermitian Gaussian matrices. Similarly, 
the free Poisson laws also occur in random matrix theory as limit distributions of eigenvalues 
for matrices of the form X*X where X is a rectangular Gaussian matrix, it is the Pastur- 
Marchenko distribution. 

Like in many other situations, relations among probability distributions signal structural 
connections, in this case a connection between free probability theory and random matrix 
theory. 

Figure 1 

Free probability theory can be described as noncommutative probability theory endowed 
with the definition of free independence. The next sections briefly explain the two terms: 
noncommutative probability theory and free independence. 

1.2 Noncommutative probability theory 

In classical probability theory, numerical random variables are measurable functions on a 
space of events Vt endowed with a probability measure yU, i.e. a positive measure of mass 
one. The expectation E{f) of a random variable / is the integral J f d^x. 

Roughly speaking, noncommutative probability theory replaces the ring of numerical 
random variables by a possibly noncommutative algebra £^ over C with unit 1 G which 
is endowed with a linear expectation functional ip : — ^ C, such that ip{l) = 1. {s^,(p) 
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is a noncommutative probability space and elements a & ^ are noncommutative random 
variables. 

Often {^Z, If) is an algebra of bounded operators on a Hilbert space M' and the functional 
if is defined by a unit-vector ^ G ^ i.e., ^p{a) = (a^,^). Typically quantum mechanical 
quantities a G are described in this way and ^ is the state-vector. 

The distribution of a random variable a G is the linear map /i^ : C[X] — * C so that 
IJ>a{P) = The information encoded in /la is the same as giving the collection of 

moments (9?(a"'))n>o- 

Similarly for a family a — {ai)i^j of random variables in =2/, the distribution is the map 
jia '■ C(Xi I i e 7) — > C so that HaiP) — v{P{{<^i)iei)) : where C{Xi \ i e I) is the algebra of 
noncommutative polynomials in the indeterminates {Xi)i^j. Like in the one- variable case, 
Ha contains the same information as the noncommutative moments ip{ai^ai^ . . . ai^) . 

In the case of a self-adjoint operator a = a*, can be identified with a compactly 
supported probability measure on a. Indeed if E{a;u!) is the projection- valued spectral 
measure of a, then 

(^(P(a)) = (P(a)e,e) = j P(t){dE(a;{-oc,t)^,0 

i.e., i^a "is" E{a; ■ 

The usual context for free entropy theory is the more restricted one of a tracial W* - 
probability space (M, r) . This means that M is a VF* -algebra (synonymous to von Neumann 
algebra) and that the expectation function r is a trace. This means that M is a self-adjoint 
algebra of bounded operators on a Hilbert space Jif (i.e. T e M ^ T* e M) which is weakly 
closed (i.e., if for some net {Ti)i^i in M, we have {Tih, k) {Th, k) for all h,k Jif , then 
T G M). The condition on r is that t{ST) = t{TS) for aU S,T e M. 

If (f2, S, h) is a probability space then M = L°°(f2, S, /x) acting as multiplication opera- 
tors on L^(f2, S, fi) is a W^*-algebra and the expectation functional r defined by the vector 
1 G is trivially a trace since M is commutative. Note that r coincides with the classical 
expectation functional on L°° defined by fx. Thus tracial Vl^* -probability spaces subsume 
the context of classical probabihty spaces. 

A fundamental class of tracial 1^* -probabihty spaces is generated by discrete groups 
G. Let A be the left regular representation of G on i'^{G), i.e. \{g)eh — Sgh where Cg, 
g E G, are the canonical basis vectors in lp{G). Then the von Neumann algebra L{G) 
is defined as the weakly closed linear space of X{G) . Roughly speaking, L{G) consists of 
those left convolution operators '^g^a -^(d) which are bounded on i"^ . The trace r is the 
von Neumann trace which is defined by the basis vector Cg (or any other eg) . Note that 
T{'^gCg X{g)) = Ce (here the next e denotes the neutral element in G). 
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1.3 Free independence 

A family of subalgebras (^)ig/, with 1 G =0^, in v^) is freely independent if 

(p{ai...an) = 

whenever </?(%) = 0, 1 < j <n and Uj e with + 1 < j < n — 1 . A family 

of subsets {oJi)i^i in [A, cp) is freely independent if the algebras ^ generated by {1} U LOi 
are freely independent. 

The above definition means that products of centered variables, such that consecutive 
ones are in different algebras, have expectation zero. Note that this does not preclude that 
= i{k) as long as \i — k\ > 2. 

In general free independence requires that variables be very far from commuting. For 
instance, if X,Y are freely independent and centered ^{X) = ^p{Y) = 0, then the free 
independence condition requires that ip{XYXY) — while commutation of X and Y 
would imply 

^{XYXY) = ^{X'Y') = ^{X'MY') 
where the last equality is derived from free independence 

<p{{X' - cpiX')l)iY' - cpiY')!)) = . 

Thus commutation is impossible if V'(X^) ^ 0, ^p{Y'^) ^ 0. 

A basic example of free independence is provided by groups. A family {Gi)i^i of sub- 
groups of a group G is free, in the sense of group theory if there is no non-trivial algebraic 
relation in G among the Gi 's which translates into the requirement that gig2 . . .Qn 7^ e 
whenever gj ^ 1 < j < n and gj e with ^ i{j + 1), 1 < j < n — 1 . It can 
be shown that in {L{G),t) the free independence of the sets {\{Gi))i^i is equivalent to the 
requirement that the family of subgroups {Gi)i^i is algebraically free. Note that this is also 
equivalent to the free independence of the von Neumann algebras generated by the A(Gj). 

1.4 Random matrices in the large N limit 

The explanation found in [33] for the clues to a connection between free probability and ran- 
dom matrices is that free independence occurs asymptotically among large random matrices. 

Very roughly the connection is as follows. A random matrix is a classical matrix-valued 
random variable. At the same time random matrices give rise to operators, i.e. to noncom- 
mutative random variables. Note that the passage from the classical variable to the non- 
commutative one means forgetting part of the information (the noncommutative moments 
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can be computed from the classical distribution but not vice versa). Then under certain 
conditions (like unitary invariance) independent random matrices give rise asymptotically as 
their size increases to freely independent noncommutative random variables. 

The noncommutative probability framework for random matrices is given by the algebras 



where {X, E, da) is a probability space, denotes the N x N complex matrices and L~°° 
stands for the intersection of i/ -spaces 1 < p < oo. The expectation functional on =<2^ is 
(fiN : — C given by 



Jx 

The simplest instance of asymptotic free independence is provided by a pair of Gaus- 
sian matrices. Let T^^^ = (a.p^y )i<p,q<Af G -s^n , j = 1,2, where a^^^^- = a^^J.j and 
{al^g]j \ I < p < q < N, j = 1,2} are independent (0, A^-^) -Gaussian. Then Ti^\T^^^ 
are asymptotically free as A?^ — > oo, in the sense that the algebraic relations among the 
noncommutative moments of the pair (T^^^^Tg"^^) which represent the free independence 
conditions, are satisfied in the limit N ^ oo. 

Among the uses of asymptotic freeness of random matrices are the study of the large A^- 
limit of random matrices with free probability techniques on one hand and on the other hand 
the operator algebra applications. Operator algebras such as the von Neumann algebras of 
free groups L(F(n)) are generated by free random variables and can therefore be viewed as 
asymptotically generated by random matrices. This has provided the intuitive background 
for many new results. 

1.5 Free independence with amalgamation 

In usual probability theory conditional independence amounts to replacing the scalar expec- 
tation functional with the conditional expectation w.r.t. a sub-cr-algebra of events, i.e., the 
expectation takes values in a sub-algebra of the algebra of random variables. 

The free analogue of conditional independence is free independence with amalgamation. 
The context is a ^^-valued probability space, i.e. (^, E, ^) where 1 e =^ C is an 
inclusion of unital algebras over C and E : ^ is ef^— ef^-bilinear and E\aj = idaj. Then 

a family of subalgebras (^)je/, C C ^ is ^-freely independent if E{ai . . .a„) = 
whenever E{aj) =0, I < j < n, aj G i{k) 7^ i{k + 1), i < k < n. 

If (M, r) is a tracial 1^* -probability space, with faithful r (i.e., t{x*x) = ^ a; = 0) 
then there are canonical conditional expectations onto von Neumann subalgebras. If / e 



'N = 



l-°°(a:,^jv) 
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N (Z M is a von Neumann subalgebra, then (mi, = T(m2mi) is an inner product on 
M and En is defined as the orthogonal projection of M onto the Hilbert space completion 
of A^. It turns out that actually En{M) C and ||i?Arm|| < ||m||. Of course for the 
L^-norm \m\2 = {T(m*m))^ we also have ||£'Arm||2 < ll^lh- Moreover is N — N- 
bilinear. This is clearly a generalization of the classical situation where M = L°°{Q,'E, n) 
and = Si, /i) with Si C S a a-subalgebra. 

If G is a group and H a subgroup let L{H) be identified with the 1^* -subalgebra 
generahzed by X{H) in L{G) . Then 



Also if C Gj C G is a family of subgroups indexed by /, then the L{Gi) are L(i7) -freely 
independent in {L{G), E^h)) iff the subgroups Gi are algebraically free with amalgamation 
over H. 

1.6 Background references 

The beginning of free probability theory is the paper [31] and the connection to random 
matrices is in [33]. A comprehensive introduction to free probability theory is given in [42] 
and for probabilists (i.e. for readers who prefer operator algebras kept to a minimum) there 
are the St-Flour lectures [39]. Some standard operator algebra books are [7], [8], [19], [29]. 

2 Matricial Microstates Approach to Free Entropy 
2.1 Underlying idea 

Shannon's entropy of a continuous n-dimensional distribution ([23]) is given by the formula 



where /i, . . . , /n are real- valued random variables with Lebesgue absolutely continuous joint 
distribution with density p{ti, . . . ,tn) ■ A free analogue to i?(/i, . . . , fn) will be a number 

xi^i, ■ ■ ■ ,Xn) [35 II] associated to an n-tuple of self-adjoint elements Xj (1 < j < n) in 
a tracial W^* -probability space (M, r), the properties of x w.r.t. free independence being 
parallel to those of H w.r.t. classical independence. 

Information-theoretic and physical entropy though different concepts, have also much 
in common. In particular, the formula for H{fi, . . . , /„) can be derived from Boltzmann's 






•n 
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fundamental formula S — klogW . The connection to the Boltzmann formula and the 
fact that free independence occurs asymptotically among large matrices, are the key to the 
definition of %. 

Boltzmann's formula says that the entropy iS of a "macrostate" is proportional to 
the logarithm of its "Wahrscheinlichkeit" W (probability), where the probability of the 
"macrostate" is obtained by counting how many "microstates" correspond to that "macrostate" 
For mathematical purposes, microstates are often associated with a given degree of approx- 
imation, and one then takes a normalized limit when the number of microstates goes to 
infinity, followed by a limit improving the approximation. 

For simplicity, here is how this works for the entropy of a discrete random variable with 
outcomes {1, . . . ,n} with probabilities pi, . . . The microstates are the set {!,..., n}^ = 
{/ I / : {1,...,N} {!,... n}} and the microstates which approximate the discrete 
distribution are r(pi, . . . ,p„; e, N) consisting of those / such that 

N 

the number of elements in the pre-image.) One then takes the limit of 

7V-ilog|r(pi,...,p„;£,iV)| 

as A?" — > oo and then lets e go to zero. Using repeatedly Stirhng's formula one gets the 
familiar — Ep^ logpj result in the end. 

To define x, the microstates will be matricial. 



2.2 The definition of x(Xi, . . . , Xn) [35 ii] 

Given Xj — X* & M , 1 < j <n, where (M, r) is a tracial 1^* -probability space, the set of 
approximating matricial microstates will be denoted FrIXi, . . . , X„; m, k, e) where R > 0, 
mGN, /cgN, £>0. Here i? is a cut-off parameter, k the size of matrices and {m,e) the 
degree of approximation. With .J^^"' denoting the self- adjoint complex k x k matrices, the 
approximating microstates are n-tuples {Ai, . . . ,An) € (^^")" such that 

\TiXi,...Xi^)-k-'TriA,...AiJ<e 

for all 1 < p < m, (ii, . . . ,ip) G {!,..., n}^ and \\Aj\\ < R, 1 < j < m. 

Let vol denote the euclidean volume on (M|")" w.r.t. the Hilbert-Schmidt scalar product 

((A, . . . , (Si, . . . , SJ) ^Yl^r AjBj . 

j 
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Taking 



lim sup(A; ^ log voirR(Xi, . . . , m, k,s) + - log k) 

fe— ♦oo 

and then 

sup inf inf 

R>0 men e>0 

of the result, we obtain • • • ? ^n) • 

Note that the cut-off R has only a minor influence, instead of the sup over R we could 
have taken a fixed R larger than , I < j < n. 

2.3 Basic properties of . . . , X„) 

X-l. Upper Bound ([35 11]) 

x{Xi, ...,Xn)< 2-^n\og{27ren-^C^) where = r(Xf + • • • + X^) . 
In particular xi^i, . . . , X„) is either finite or — oo. 

X.2. Subadditivity ([35 11]) 

X(Xi, . . . , X^+„) < x(Xi, . . . , X^) + x{Xm+l, ■ ■ ■ , Xjn+n) ■ 

X-B. Semicontinuity ([35 II]) 

Assume < C < oo, 1 < j < n, p e N and (xf \ . . . , rf) 

converges in distribution to {Xi, . . . , X„) , i.e. 

limr(xif)...xif))=r(X,...Xj 

p— »oo 

for all noncommutative moments. Then 

limsupx(xj^\ . . . ,X(rt) < x(X,, ...,X^). 

p—*oo 

X.4. One Variable Case. ([35 11]) 

X{X) = J J log \s - t\dii{s)dii{t) + I + i log 27r 

where ji denotes the distribution of X . Thus, up to constants, x(^) is 
minus the logarithmic energy of ii. 

X.5. Additivity and Free Independence. ([35 IV]) 
Assume x{Xj) > — oo, 1 < j < n. Then 

x(Vi, . . . , Xn) = x{Xi) + • • • + x{Xn) iff Xi, . . . , Xn are freely independent. 
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X.6. Semicirculeir Mciximum. ([35 II]) 

Assume T{Xf) — • • • — t{X^) — 1 . Then x(Xi, . . . , X„) is maximum iff Xi,. . . ,Xn 
are freely independent and have (0,1) -semicircular distributions. 

X-7- Infinitesimal Change of Variables. ([35 IV]) 

Let C(ii, . . . ,tn) be the ring of noncommutative polynomials in the indeterminates 
ti, . . . ,tn endowed with the involution * so that {cti^ ■ ■ - Up) — cti^ ■ ■ - U^- Then: 

-^X(^l+£A(^l,...,^n),...,^n + £Pn(^l,...,^n)) 

£=0 

- J](r®T)(a,P,(Xi,...,Xj) 

i<i<i 

where P,- = P/ G C(ti, . . . , t„) and 9^ : C(ti, . . . , tn) ^ C(ii, . . . , ® C(^i, . . . , t„) is 
given by ■ . . . = J2i,=j th ■ ■ ■ ti^_, ^ U^+^ ...U^. 

X.8. Degenerate Convexity. ([35 III]) 

Assume n > 2 and there are trace-states r', r" on A = W*{Xi, . . . , Xn) so that r' ^ t" 
and T = ^r' + (1 - ^)f' on A, < ^ < 1. Then x((Xi, . . . ,X„) = -oo. 



Renicirks: 

a) It is an important open problem, whether replacing the lim sup in the definition of x by 

a liminf (as k ^ oo) yields the same quantity. While this is unresolved it is sometimes 
convenient to use Xw, an ultrafilter on N, the quantity obtained by replacing the 
lim sup by a limit as /c — > a; . 

b) Generalizing the "if "-part of x-5. to groups of variables runs into the problem discussed 

in a). There is a partial generalization ([36]) 

if {Xi, . . . , Xjn} and {X^^i, . . . , Xj^+n} are freely independent. 

c) We preferred to state the weaker infinitesimal version of the change of variable formula 

because it is easier to state and will be used later. Roughly the change of variable 
formula is of the form: 

x(Pi(Xi, ...,Xn),..., Pn(^i, ...,Xn))= x{Xi, ...,Xn)+ log |det| (Z^P(Xi, . . . , X^)) 
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where there is a long hst of details about the noncommutative power series (Fi, . . . , F„) , 
the Kadison-Fuglede determinant | det | and the differential DF for which the reader 
is referred to the original paper [35 II] . 

d) Given Xi, . . . , X„ and m e N, £ > is there k eN and > so that 

r«(Xi,...,X„)m,A;,£)^0? 

This very basic question is equivalent to a problem of A.Connes on embedding II i- 
factors into the ultraproduct of the hyperfinite II i -factor. 

e) The "if "-part of x-5. relies essentially on asymptotic freeness of random matrices. What 

the result and its proof show, is a sharp difference between one- and multi-random 
matrix theory. Roughly, if n = 1, then sets of microstatcs rR{X;m,k,e) will be like 
tubes around the unitary orbit of some microstate {U AU* \ U E '^{n)} . If Xi, . . . , X„ 
are freely independent and n > 1, then Tji^Xi, . . . , X^, m, k, s) is much larger than a 
tube around {{UAU*, . . . , UAnU*) \ U e ^{n)}, actually up to sets, the measure of 
which goes to as A; — > oo , it is more like the product of tubes around the orbits of 
the components, i.e. {UAkU* \ U E^{n)}. 

2.4 The free entropy dimension [35 ii] 

The free entropy being a normalized limit of logarithms of volumes of sets of matricial 
microstates, there is also a corresponding normalized dimension of sets of microstates. The 
definition is reminiscent of the definition of the Minkowski content. 
The free entropy dimension 8{Xi, . . . , X„) is given by the formula 

r/T^ v\ I 1- x{^i + £Si,...,Xn + eSn) 
o(Ai,...,A„j = n-|-limsup ■ 

elQ I log £ I 

where Si, . . . ,Sn have (0,l)-semicircular distributions and {Xi, . . . , Xn}, {Si}, . . . , {'S'„} are 
freely independent. 

In a number of apphcations it is necessary for technical reasons to use a modification 
5q{Xi, . . . , X„) of 5. It is not known whether 5 and 5q are actually different. 8q is obtained 
by replacing xi^i + ^^i, . . . ,Xn-\- eSn) in the definition of 5 by x{^i + ^^i, . . . ,Xn-\- eSn ■ 
Si, . . . , Sn) where xi^i^ ■ ■ ■ ■> '-Yi,---, Yp) is defined like x using 

Tr{Xi, ...,Xn:Yi,...,Yp;m,k,s)= pr{i,...,„}rij(Xi, . . . , Yi, . . . , F^; m, k, e) 



10 



Since all this becomes rather technical, we will limit our discussion to 5 in the rest of this 
section. 

Here are some basic properties of 5 . 

a) S{Xi, . . . , Xn) < n. We also have S{Xi, . . . , X^) > when the problem in 

2.3-Remark d) has an affirmative answer for Xi, . . . , X^. 

b) 5{Xi, . . . , X„i+n) < ^(-^1; • • • ! ^rn) + ^(-^m+l, • • • , Xm+n) 

c) S{Xi, . . . , Xn) = S{Xi) + ■ ■ ■ + S{Xn) if Xi, . . . , Xn are freely independent. 

d) 8{X) = 1 — ^(Ai({t}))^ where jji is the distribution of X . 

e) . . . , J^n) > -oo ^ . . . , X„) = n. 
2.5 Operator algebra applications 

Free entropy has led to new results on von Neumann algebras, in particular the solution of 
some old problems has been found. The new results are about separable II i factors, i.e. von 
Neumann algebras M of infinite dimension acting on separable Hilbert spaces, which have 
a faithful trace-state r and trivial center Z{M) = CI. Typical examples are the L(G) 's 
where G is a countable discrete group with infinite conjugacy classes. 

1° Absence of Cartan Subalgebras ([35 III]) 

The free group factors L{F{ri)) {n > 2) have no Cartan subalgebras. A Cartan subal- 
gebra A G M {M a IIi factor) is a maximal abelian Ty*-subalgebra, the normalizer 
of which N{A) = {u E M \ u unitary, uAu* = A} generates M . The concept mimics 
the properties of the algebra of diagonal matrices inside the algebra of n x n matrices. 
M has a Cartan subalgebra iff it can be obtained from an ergodic measurable equiva- 
lence relation via a construction of Feldman and Moore ([13]). It was an open problem 
whether all separable II i factors arise this way from ergodic theory. 

2° Prime IIi factors ([15 II]) 

L[F{n)) {n > 2) is prime, i.e. is not a iy*-tcnsor product Mi®M2 of oo -dimensional 
von Neumann algebras. The existence of separable II i factors was also an old open 
question. 

3° Products of abelian subalgebras ([30]) 

If n is large enough, L{F{n)) is not the 2-norm closure of the linear span of a product 
Ai . . . Am of m abelian 11/"* -subalgebras. 

Using a fundamental theorem of A.Connes, by which all separable Ili-factors L{G) 
with G amenable are isomorphic, it follows that in the amenable case L{G) = span 
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for a pair of abelian l^*-subalgebras. This is in sharp contrast with the L{F{n)) sit- 
uation. 

The principle underlying the proofs of these results is to show that a certain property 
(existence of a Cartan subalgebra, non-primeness, product of abelian, etc.) implies that a 
generator Xj = X* (1 < j < n) of the von Neumann algebra has x(-^i) ■ ■ ■ , Xn) — —oo . On 
the other hand L{F{n)) has a generator Xi, . . . , X^ with x(Xi, . . . , Xn) > — oo (consider 
Borel-logarithms of the generating unitaries X{gi) ■ ■ ■ X{gn) and use x.4 and x.5). This kind 
of result, started by the absence of Cartan algebras result ([35 III]) has meant developing 
increasingly ingenious ways of estimating volumes of matricial microstates for generators 
([12], [15], [30]). 

Note also that for most of the above results there are stronger forms, where x(^i) • • • ) ^n) = 
— cx) is replaced by So{Xi, . . . ,Xn) < 1 for a generator. In this direction there is also the 
following recent result. 

4° Property T ([15 III]) 

If Xj = X* {1 < j < n) is a generator of L{SL{rm + 1;Z)) (m > 1) then 
5o{Xi, . . .,Xn) < 1. 

The restriction to odd numbers 2m + 1 is only to insure factoriality (i.e. trivial center). 
2.6 Comments on the microstates approach 

The use of microstates , per se, in the definition of free entropy, should not bother us too 
much. There are many other situations in mathematics where huge auxiliary objects are used 
to define some basic invariants (singular homology may come to mind for instance). On the 
other hand, the technical difficulties in this approach which prevented us from completing 
the theory (see, for instance. Remarks a) and b) in 2.3) are a problem. 

Much impetus for further developing free entropy theory is provided by von Neumann 
algebras. There is some hope that with stronger free entropy tools at hand, the currently 
best known problem in the area may be settled in the affirmative: 

L[F{n)) isomorphism problem. 

Does L{F{n)) ~ L{F{m)) imply m — nl 

An even more far-fetched question is whether for the free entropy dimension, or for some 
variant of it, there is an affirmative answer to: 
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The entropy dimension problem. If Xj ^ X* e M , Yk ^ e M , 

1 < j < n, 1 < k < n, does W*(Xi, . . . , X„) = W*(Yi, . . . ,YJ imply 
S{X,,...,X^)^S{Y^,...,YJ1 



Under certain conditions, an affirmative answer to the preceding problem would follow (see 
[35 II]) from an affirmative answer to: 



Little is known about these questions. About the semicontinuity problem it is only known 
that in the rather uninteresting case n = 1, the answer is yes ([35 11]). For certain variants 
of 6, the much weaker free entropy dimension problem, with the VT* -algebras replaced by 
the algebras (no closures) of the X's and F's, the answer is affirmative ([36]). Also the 
isomorphisms of various free product von Neumann algebras ([10], [11], [22], [34]) seem not to 
contradict the invariance of 5 on generators. Finally, it is known [22] that there are only 
two possibihties in the isomorphism problem: either all L{F{n + 1)), n e N U {oo} are 
isomorphic or all are non-isomorphic. 

3 Infinitesimal Approach to Free Entropy 
3.1 Fisher information background 

The Fisher information ^(/) of a real random variable / is the derivative of the entropy 
in the direction of a Brownian motion starting at /, or equivalently: 



where g is a (0,1)-Gaussian variable independent of /. Using the Brownian motion starting 
at / one can then express H via ^ , 



On the other hand, if the distribution of / is Lebesgue absolutely continuous with smooth 
density p, then one finds 




p— >oo 



hminf 5(X^\ X^^) > 5(X,, . . . , X„) ? 



H{g) - H{f) = I /~(^(/ + th) - (1 + t)-')dt . 
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The last formula can also be expressed as an L^-norm 



or equivalently 



The Fisher information initially appeared in statistics, where it was defined by the preceding 
formula with ^ (/) being the so-called score-function of /. The score is also fundamental for 

other reasons: a) infinitesimally the effect on the distributions of the perturbations f + e^g 
and / + 1 ^{f) is the same; b) the score is a gradient for the entropy when the perturbations 
of / are of the form / -|- eQ{f) where Q is a polynomial. 

Related to property a) of the score the element p'/p e L'^{^,pd\) can also be described 

as: 



P 



d 



p ^dV 

where is the operator of derivation densely defined on polynomials in 
is smooth with compact support. In particular, 



^,pdX) and p 



/if) 



dy^ 



Based on properties of the free entropy x one-dimensional computations [35 I], 

it turns out [35 V] that the free analogue of the Fisher information can be obtained, roughly 
speaking, by replacing the operator of derivation d/dt by some difference quotient, which 
sends a polynomial P{t) to the two-variable polynomial: 

s-t 

Dealing with several noncommuting variables will involve noncommutativc generalizations of 
the difference quotient, like the derivations appearing in the infinitesimal change of variable 
formula for x- 
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3.2 The free difference quotient 



Let X = X* G M and 1 G -B C M be a *-subalgebra such that X and B are algebraically 
free (i.e., no non-trivial algebraic relation between B and X). We denote by B[X] the 
algebra generated by B and X and consider the linear map: 

dx:B : B[X] ^ B[X] ® B[X] 

so that 

dx.BboXbiX ...bn= ^ boX . . . bk-i bkX . . .bn ■ 

l<k<n 

With the natural i?[X]-bimodule structure on B[X] ® the map dx-.B is a derivation 

and it is the only one such that dx:B\B = and dx.B^ = 1 ® 1. 

Note that the partial derivation appearing in the infinitesimal change of variable formula 
for X correspond to taking B = C[Xi, . . . , Xj, . . . , X^] and X = Xj (here Xi, . . . , X„ are 
algebraically free, noncommuting) . 

B[X] is a hnear subspace of L'^{M,t) and we shall consider LF'{B[X\,t) the closure of 
B[X]. 

3.3 The conjugate variable ^ [X : B) [35 v] 

In the context of the preceding section dx-.B is a densely defined unbounded operator from 
L'^{B[X],t) to L'^{B[X],t) ® L'^{B[X],t). We define / {X : B) = 9^^^! ® 1 if it exists 
and call it the conjugate variable to X (w.r.t. B). 

Several other names are appropriate for ^ {X : B): noncommutative Hilbert transform, 
free Brownian gradient, free score. All these designations correspond to properties of ^ {X : 
B) which will be described in what follows. In particular the passage from the usual (partial) 
derivative to the free difi^erencc quotient justifies the "free score" name. 

Here are some basic facts about ^ {X : B) . 

Hilbert transform. If the distribution of X is Lebesgue absolutely continuous 
and has density -p G L^{^,dX), then ^{X : C) — g{X), where g — 2ttHp, with H 
denoting the Hilbert transform. 

^.2. Enlarging the scaleirs. If 1 G C C M is a *-subalgebra and C and B[X] are 
freely independent in (M, r) then 

^{X:B) = ^iX:B\/C) 
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where S V C is the algebra generated by B and C. (There is a strengthening of this 
in [25]: it suffices to assume C and B[X] are freely independent over B in {M,Eb)-) 

^.3. Semicircular perturbations. If S is (0,1) semicircular and B[X] and S are freely 
independent and £ > 0, then 

J{X + eS:B)h^e-'EBix+eS\S . 

In particular, \\^ {X + eS : B)\\ < 2£~\ and the set of selfadjoint X for which 
\\J^{X:B)\\ < oo is norm-dense in the selfadjoint part of M . 

^A. Closability. If \ ^ {X : B')\2 < oo then d*x.B is densely defined and dx-.B is closable. 

^.5. Free Brownian gradient. If S is (0,1) semicircular, B\X\ and S freely indepen- 
dent, \^{X •.B)\i<oo and £ > 0, then: 

r{h,{X ^\j{X: B)MX + '-^ {X : B)) . . . 6„) 
= T{bo{X + e-^S)h{X + e-2S)...bn)+ 0{e^) . 

^.6. Gradient of Let Xj = X* e M , I < j < n and assume that 

x(Xi,...,X„) > -oo and that = ^{Xk : C[Xi, . . . X^, . . . , Xj) , 1 <k <n 
exist. Then 

^X{Xl+ePi,...,Xn + ePn)\e=0 = Yl '^^Pkjk) 

l<k<n 

where = P^ e C[Xi, . . . , X„] , l<k<n. 
3.4 ([35 V]) 

In the infinitesimal approach, the relative Fisher information ^*{Xi, . . . , Xn : B) of an 
n-tuple of selfadjoint variables Xi,...,Xn with respect to the subalgebra B is defined by 

$*(Xi,...,X„:5)= \J{Xk:B[X^,...,Xk,...,Xn])\l 

l<k<n 

if the right-hand side is defined and +oo otherwise. The asterisk is to distinguish quantities 
in this approach from the corresponding quantities in the matricial microstates approach. 
Here are some properties of $* . 
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Superadditivity. 

^*(X,,...,Xn,Y,,...,Yrn:B)>^*(X,,...,Xn:B) + ^*{Yi,...,Y,n:B) 

$*.2. Free additivity. If B[Xi, . . . , X„] and C[Yi, . . . , Ym] are freely independent, then 
$*(Xi,...,X„,ri,...,r^:SVC) = $*(Xi,...,X„:5) + $*(Fi,...,r„:C). 

$*.3. Free Cramer-Rao inequality. $*(Xi, . . . ,X„ : 5)r(Xf H hX,^) > . Equality 

holds iff Xj arc semicircular with T{Xj) = (1 < j < n) and B, {Xi}, . . . , {Xn} are 
freely independent. 

$*.4. Free Stam inequality. If B[Xi, . . . , Xn] and C[Yi, . . . , y^] are freely independent, 
then 

(<I>*(Xi + Fi, . . . , X, + : 5 V C))-i > ($*(Xi, . . . , X„ : 5))"^ + (<f . . . , : C))- 

$*.5. Semicontinuity. If = xf^* e M and s - hmXf ^ = X,-, then 
hminf $*(Xf \ . . . , : 5) > . . . , X„ : 5) . 

$*.6. If $*(Xi,...,X„ : B) = $*(Xi,...,X„ : C) < oo then {Xi,...,X„} and S 
are freely independent. If $*(Xi, . . . , X„, Fi, . . . , F„ : C) = $*(Xi, . . . , X„ : C) + 
$*(Fi, . . . , F^ : C) then {Xi, . . . , X„} and {Fi, . . . , F^} are freely independent. 

3.5 x%X,,...,Xn:B) 

The free entropy of Xi, . . . , X„ relative B , in the infinitesimal approach is defined by 

X*(Xi, . . . ,X„ : 5) = i/^;" - $*(Xi + t^^i, . . . ,X„ + : dt + f log27re 

where the 5"^ 's are (0,l)-semicircular and -B[Xi, . . . , X„], {^i}, . . . , {5'n} are freely indepen- 
dent. 

Here are some properties of x* ■ 
XM. x(^:C)=x(X). 

X*.2. x*(^i,---,^n)<flog(27rn-iC2) where ^ T{Xf + ■ ■ ■ + X^) . 

X*.3. If -B[Xi, . . . ,X„] and C are freely independent, then 
X*(Xi, . . . , X, : B) = x*(Xi, . . . , X„ : S V C) . 
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X*.4. Subadditivity. 

X*(X,,...,Xr„Y,,...,Ym:ByC)<x*(X,,...,Xr,:B)+x*(Y^,...,Y^:C) 

X*.5. Free additivity. If B[Xi, . . . , Xn] and C[Yi, . . . , Ym] are freely independent then 
the inequality x*.4 is an equality. 

X*.6. Semicontinuity. If s — lim Xj'^^ — Xj then 
limsupx*(xf \ ...,Xi'^ :B)<x*{X,,...,Xn:B). 

fc— >oo 

X*.7. Information log-Sobolev inequality. If $*(Xi, . . . ,Xn : B) < oo then 

' particular 

X*(Xi,...,X„:S)>-oo. 

3.6 Mutual free information and the derivation 8a:B [35 vi] 

In the classical context, if f,g is a. pair of numerical random variables with H{f), H{g), H{f, g) 
finite, then their mutual information is 

I{f-g) = H{f) + H{g)-H{f,g) . 

Via an approximation procedure, the definition of /(/, g) can be extended well beyond the 
case of finite entropies (even Lebesgue absolute continuity of distributions is not a require- 
ment, see [6]). It also turns out that I{f,g) depends only on the position of the von Neumann 
algebras of / and g inside the von Neumann algebra of {f,g} endowed with the expectation 
functional [in classical terms: the triple of cr-algebras of /, respectively g, and respectively 
(/, (7)-measureable events and the probability measure]. Note however that there is no in- 
finitesimal theory for /(/, g) unless one is in the finite entropy case and uses the infinitesimal 
theory for entropy, i.e., there is no infinitesimal theory at the level of algebras, since there is 
no natural deformation of the pair of algebras in sight. 

In the free context, the situation is different. Given two von Neumann subalgebras 1 e ^4, 
1 e S in (M, r) there is a natural "liberation process" which deforms the pair (^4, B) to 
a freely independent pair: A,U{t)BU{t)* where {U{t)}t>o is a multiplicative unitary free 
Brownian motion which is freely independent from Ay B . This means {U{t)}t>o is the free 
analogue of the corresponding classical Brownian motion on the unit circle and can also be 
described, in view of the asymptotic freeness of random matrices as the large N limit of 
Brownian motions on the unitary groups U{N) (see [2]). Via some heuristic considerations 
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this leads to an infinitesimal approach to a quantity i*{A, B) which should play the role of 
the mutual free information for the pair [A,B). 
The infinitesimal approach relies on a derivation 

5a:b : Am b ^ {Am b) ® {Ay b) 

which exists under the assumption that A and B are algebraically free (i.e., no non-trivial 
algebraic relation). Here {AM B) ® {AM B) is with the obvious A\/ B bimodule structure 
and 

^a-.bo. = a ®1 — 1® a if a E A 
6A:Bb =0 if 6 G 5 . 

Like in the infinitesimal approach to free entropy, the key construction is the liberation 
gradient 

j{A : B) = 6*^,^1 ® 1 

where Sa-.b is viewed as an unbounded operator densely defined on L'^{W*{A V B),t) with 
values in L^{W*{{A V (A V 5)), r r) . 

We list some of the main properties of j{A : B) . 

j.l. Liberation gradient. j{A : B) — —j{A : B)* and 

ri n U{e)akU{e)%A^Ti \{ {^{A : B))ak e^v {- ^ji^ : B))hA+0{e^) 

\l<A;<n / \l<A;<n / 

where e A, bk E B , JJ^ denotes the ordered product and {U{t))t>o is the multi- 
plicative unitary free Brownian motion free w.r.t. AV B . 

j.2. j(^:C) = and ^ j(A : A V • • • V ^l^-i V A^+i V . . . A„) = 

l<k<n 

j.3. If A, B, C is freely Markovian (i.e. A and C are freely independent over B in (M, Eb) ) 
then 

3{A:B) = j{A:ByC) 
j{A:C) = EAvcj{B:C) 

j.4. If U is unitary and AV B and {[/, U*} are freely independent, then 

j{A:UBU*)=Eavubu*j{A:B) 



19 



and if the distribution of U is absolutely continuous w.r.t. Haar measure, dji — pd6, 
p E , then 

j{A : UBU*) = -lEAyuBU* 9{U) 
1 /" 

where qie^^^) = p. v. / tttt-t d9 is the Hilbert transform. 

^ 2n J tan(^/2) 

j.5. \\{Ea-Eci){Es-Eci)\\< 11^(^-^)11 



il + \\jiA:BW)h 
(The left-hand side is the norm of an operator on L'^{M, r) .) 

j.6. j{C[X,, ...,X^]:B)^ EkUiXk : B[X,, ... X,, ... , X^]),X,] 
(if the right-hand side exists) . 

j.7. j{A : B) = <^ A, B are freely independent. 

The liberation Fisher information (p* is defined by 

^*{A:B) = \j{A:B)\l 

if j{A : B) exists and = -|-oo otherwise. 

Among its properties is an inequality for freely Markovian triples A, B, C which resembles 
the Stam inequality 

ip*{A:C)-^ > ip*{A: B)-^ + ip*{B :C)-^ . 
Finally, the mutual free information i* is then given by 

e{A:B) = \j^^*{U{t)AU{tY:B)dt 
where {U{t))t>Q is the unitary free Brownian motion which is free w.r.t. AM B . 

3.7 A variational problem for xi^ii • • • ? ^n) 

It is a natural variational problem for the free entropy to maximize 

x(Xi,...,X„)-t(P(Xi,...,X„)) (*) 

where Xj = X* E {M,t), 1 < j < n and P = P* E C(ti, . . . ,t„) (see x-7 in 2.3 for this 
notation). The question is to find the joint distribution of (Xi,...,X„) for which (*) is 
maximum. ((M, r) is a "universal" II i factor containing all separable II i factors.) 
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It is interesting to note that this problem, about which we know very httle in this gener- 
ahty, appears to be connected to an important class of random matrix models, about which 
similarly very little is known in full generality. To explain this, we shall consider the critical 
point condition, which is a consequence of {Xi, . . . , X^) being a point where the maximum 
is attained: 

^ Xi^l + £Pl{Xi, . . . , Xn), . . . , Xn + ePn{Xi, . . . , Xn))\e=0 

= ^ t{P{X, + £Pi(Xi, . . . , . . . , X„ + ePn{X,, X„))|,=o 
Let dj denote d-)^,.^^-^_^ j^, and let dj denote the cyclic derivative w.r.t. Xj, i.e., 

dj — m o o dj 
where ~ is the flip for C[Xi, . . . , X„] ® C[Xi, . . . , X„] and 

m : C[Xi, . . . (8) C[Xi, . . . ^ C[Xi, . . . 
is multiplication. Then the critical point condition in view of %.? becomes 

l<j<n 

which in view of 3.3 means precisely that the conjugate variables 

A = /(X, :C[Xi,...X,,...X,] 

exist and that 

/k ^ dkP l<k<n. (**) 
Note that an equivalent way of stating these conditions is 

J2 r{Xi, . . . X,._MXi,+^ ■ ■ ■ Xi,) = t{X,, . . . X,^(4P)(Xi, . . . , Xn)) (* * *) 

ij=k 

for all 1 < A; < n and monomials Xi-^ . . . Xi^ . 

The same equations (sec [9] for instance) appear in the study of the large N limit of the 
general random multi-matrix model arising from a probability measure with density 

cjv e-^Trp(A„...,^„) 
on the space of n-tuples of hermitian N x N matrices. 
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Like in the study of random matrix models also for the variational problem (*) , it is 
natural to assume certain lower bounds for P . For instance the condition 

r(P(Xi, ...,Xr,))>A + B \ogT{Xl + --- + XI) 

where -B > | combined with x.l gives 

. . . - r(P(Xi, ...,X^))<K -e\ogT{Xl + • • • + X^) 

for some constants K and £ > which then will give a bound on t{XI + h X'^) for a 

maximum. 

For the reader familiar with one random matrix models, let us point out that for n = 1 , 
the variational problem (*) with ii = /ix the distribution of X = Xi, becomes in view of 
X-4: 

J J log \s -t\dfx{s)dfx{t) - J P{t)dfx{t) 

while the equation (**) in view of ^ .1 becomes 

{2t^H^x){X) = P'{X) 

or equivalently 

2TTHix{t) = P'{X) 

H - almost everywhere (i.e., under continuity conditions for t G supp //). 

These arc familiar objects in the study of 1-random matrix models in the large N limit 
and free entropy appears to provide the generalization of these for multi-matrix models. 

3.8 Comments 

In this section wc briefly discuss some of the problems encountered in the effort to complete 
the theory and we also briefly mention further work in this area, not covered in the previous 
sections. 

Unification problem. The ultimate goal of a complete theory also would mean unifi- 
cation of the matricial microstates approach, the infinitesimal approach and the mutual free 
information defined using 5a:b and the liberation process. This would mean in particular 
proving general results of the form 

x(Xi,...,X,)=x*(Xi,...,X„) 
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and 

i*{W*{X^,...,Xn):W*{Y^,...,Y^)) 

= . . . ,X„) + xiYi, ...,Yra)- x(Xi, . . . Fi, . . .,Ym) 

(when the x's in the right-hand side are finite). 

Clearly such results are a long way to go from where the theory is at present. As always 
skeptics would raise the perspective of a negative answer. On the other hand the results 
paralleling the classical theory, obtained thus far, coupled with our general faith in beautiful 
mathematical theories should be reasons for optimism that some form of a complete theory 
and unification are possible. Prom a more pedestrian point of view it is clear that unification 
will also very much depend on solving the technical problems in completing each of the three 
directions. 

Technical problems. Developing free entropy theory in the infinitesimal approach, the 
problems one is facing at present are "free analysis" questions. Here is perhaps the simplest 
continuity question one would like to settle in the affirmative: 

is ^ {Xi + ^5"!, . . . , Xn + tSn) e L'^{M, r) a continuous function of t & (0, oo)? 
Here Si, . . . ,Sn are (0, 1) -semicircular on {Si}, . . . , {Sn}, {Xi, . . . , Xn} are freely 
independent in (M, r) .) 

The question is equivalent to the apparently weaker question: 

is $*(Xi + tSi, . . . , Xn + tSn) as a function of t E (0, oo) right continuous? It 
is known the function is left continuous and decreasing. 

Under this form the one- variable case, n = 1, has been answered in the affirmative in [41]. 

The problem of establishing a change of variables results for x*(Xi, . . . ,X„) also runs 
into difficulties, part of which are related to continuity questions like the preceding one. 

Free Fisher information relative to a completely positive map. Several results 
in the infinitesimal approach have been shown to hold in a more general framework involving 
a unital completely positive map rj : B ^ B ([25]). Instead of letting dx-.B take values in 
M ® M endowed with the scalar product derived from t ®t one uses the scalar product 

{xi®X2,yi®y2) = T{xlr]{EB{x\yi))y2) . 

One context where this generalization has a natural microstates counterpart occurs in the 
study of Gaussian random band matrices [24], [17]. Another context involves measure- 
preserving equivalence relations, and a free probability interpretation [26] of the recent work 
on the cost of such equivalence relations [14]. 
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Lcirge deviations. Recent work on large deviations of Gaussian random matrices, up to 
technical differences, can be viewed as aiming to prove a strengthening of the equality of the 
free entropy via microstates x to the free entropy x* defined via an infinitesimal approach, 
i.e., a strengthening of the unification problem. Slightly more precisely, the asymptotic of 
/c"^ log vol r(A;) where r(A;) is a set of matricial microstates specified by giving intervals 
for a finite number of normalized noncommutative moments, should be evaluated by the 
supremum of a rate function, involving the free entropy x* , over the n-tuples of hermitian 
operators in tracial 1^* -probability spaces satisfying the moment conditions. Even more 
precisely, the preceding should be amended by taking Gaussian measure, removing cutoffs, 
replacing usual moments by traces of products of some noncommutative resolvents, etc. 

In the one-variable case, both free entropy [35 II] and the large deviation question [1] 
are completely clarified and fit quite well together. In several variables a complete large 
deviations result, up to some technical differences on microstates, would imply affirmative 
answers to the lim sup, versus lim inf problem in Remark a) of 2.2 and of the Connes problem 
in Remark d) of 2.2. Having in mind that a full large deviations would imply the solution of 
these difficult problems, note that the n-variable results in [5] provide at present the closest 
result to a majorization of x by x* ■ Besides the technical differences concerning microstates 
pointed out above, there is one more important modification in [5] to be pointed out: is 
modified by the -distance of {^{X^ : C[Xi, . . . , Xk, . . . , -'^n]))i<fe<n to the set of cyclic 
gradients. This leads naturally to the problem whether this L^-distance is zero, i.e., whether 
the modification of $* is not really a modification of the quantity? Very little is known 
about this. A purely algebraic result in [38] implies the distance is zero when the partial free 
Brownian gradients {^{X^ '■ C[Xi, . . . , X^, . . . , X„]) are noncommutative polynomials in 
Xi, . . . ,Xn- In a forthcoming paper by T. Cabanal-Duvillard and A. Guionnet it is shown 
that the n-tuples of noncommutative random variables for which Connes' problem has an 
affirmative answer, are in the closure in distribution of those for which the above question 
has an affirmative answer. 

In another direction it is important to note that the large deviation work [5] has brought 
powerful stochastic analysis techniques, applied to matricial Brownian motions, to bear on 
the problems in this area. 

Some extremal problems. Important classes of operators in II i -factors, like the cir- 
cular elements, are the solution to extremal problems for entropy [21]. 

The coalgebra of dx-.B- The derivation of dx-.B is a comultiplication for a coalgebra 
structure on -B[A"]. This leads to a class of coalgcbras where the comultiplication is a 
derivation, which has remarkable duality properties closely related to results on conjugate 
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variables ^{X :B) ([31]). 
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Basic Laws 

Continuous lines = Densities, dots = Dirac Measures. 
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